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(54) Tttie: SYSTEM AND METHOD FOR DYNAMIC TIME AND BANDWIDTH ALLOCATION 

(57) Abstract 

The present invention 
comprises a control system 
developed to efficiently 
share one or mm satellite 
transponders or links among 
multiple satellite uplinking 
earth stations. The control 
system uses a tenestrial 
communications link, such as 
the Internet, to control access 
to the transponder or satellite 
links. Ommunications 
over this link may employ 
a TCP/IP protocol to connect 
the requesting uplinking earth 
stations with a centralized 
controller. . The centiatized 
controller may employ an 
algorithm to automate the 
process of gaining access 
to the satellite resources via 
terrestrial link. The control 
system (also refened to 

herein as the master arbitration server) for each transponder is placed in a centralized location, where it is accessible to all uplinking earth 
stations. It accepts requests via a terrestrial link to share a satellite transponder. All uplink stations that are requesting access to the 
satellite resources are identified such as by an IP address in the case of the Internet terrestrial link. Each satellite resource is identified by 
an authorization message generated by the master arbitradon server. Requests are processed in a centralized location and result in channel 
assignments specified in temis of scheduled transmission start time, end time, frequency, and bandwiddi, as well as other parameters for 
diat satellite resource. An authorizing message is transmitted back to die uplink station when access is granted containing the resource 
grant specifications. A satellite resource may be granted in eitiier a batch (continuous) or time division multiple access modes, as 
requested. Advantageously, die control system of die present invention can be applied to analog video, high-speed data, or other satellite 
transmisslms. 
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SYSTEM AND METHOD FOR DYNAMIC TIME AND BANDWIDTH ALLOCATION 

Related Applications 

This invention claims priority to U.S. provisional application serial no. 
60/129.988, filed April 18. 1999. which application is hereby incorporated in its 
entirety by this reference. 

Field of the Invention 

The present invention generally relates to satellite data networi<s. and more 
particularly, to systems and methods for managing two-way satellite data networic 
systems through a centralized central server utilizing a terrestrial link. Methods and 
systems are also disclosed for dynamic bandwidth allocation using a hybrid rate 
allocation and time-slicing mechanism with distributed, hierarchical control. 

Background of the Invention 

Data communication via satellite has grown with leaps and bounds recently. 
That growth has reduced transmission costs and increased usage - but at the cost 
of bandwidth congestion. In part, the congestion is due to an operation environment 
that utilizes static channel assignments with scheduling based on manual time 
resen/ation mechanisms. 

For mampie, in the past distributing television, cable and other video/sound 
files to local stations around the country has been done by manually scheduling the 
feeds. Typically, a satellite transmitter has a fixed allocation of bandwidth and, if a 
user needs to transmit 10 minutes worth of data, the user would manually place a 
phone call to a provider and say I would like 1 0 minutes of transponder time at 4:00 
p.m. This negotiation for transponder time is time consuming and inefficient and 
may result in the user being forced to purchase an hour's worth of transponder time 
when ail he needs is 10 minutes. Consequently, once the user finishes transmitting 
his data, the transponder sits donnant for the remaining 50 minutes, which results in 
wasted capacity. Currently, no providers have a system that pnamotes the efficient 
use of transponder time through the re-use and sharing of previously dedicated 
facilities. 

Some alternative satellite providers are looking at reliable multicast 
transmission to be a key technology that can be used to minimize network traffic. 
Coordination is a major problem with multicast file distribution over a satellite. In 
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Other words, how can many content providers (e.g., channels, news organizations, 
etc.) distribute their content without ovenvhelmtng the networic bandwidth? This is 
especially a problem where bandwidth allocation is handled through a manual 
system. 

A second problem in multicasting files over a satellite communications 
network is that you cannot detennine exactly when your file is sent. Klo one can 
know with certainty when a particular transmission will end. In the past, people have 
dealt with this problem by statistically evaluating the data transmission infomiation to 
detennine a statistical end point over time. That is, by looking at a number of 
transmissions after the fact, one can figure out how many actually went through on 
time. Usually, that percentage is very high - in the 90% range. It can be made even 
higher, but the tradeoff typically is a less efficient use of satellite transponder time. 
In other words, if you want to really know that your file is going to be sent over the 
satellite when you schedule it, you need, overall, to schedule less traffic than the 
system can handle. In essence, this is very like what a doctor does in scheduling 
patient appointments - if the doctor wants to make sure he sees the maximum 
number of patients she will schedule lots of appointments over the day. But, as tiie 
day progresses, the delay between when the doctor sees the patients and the 
patients' appointment times lengthens. The doctor can fix this by reducing the 
number of appointments, but then the doctor runs the risk of having some down time 
during which no patient is scheduled. 

In any event, if bandwidtti is allocated based on these statistical averages, 
inevitably some jobs will not be completed within tiie allocated transmission time. 
Skilled persons in this area say this means.tiiat your file completion times are "non- 
deterministic." The non-detenministic file transmission causes scheduling difficulties 
in projecting future start times for otiier data transmission. This can be a critical 
problem. For instance, consider a breaking news story, such as a presidential news 
conference, tiiat a network wants to make sure gets out across the country to 
various local affiliates. It is critical tiiat the network knows that at the set time \he 
news story will be transmitted. You would nomially think that to guarantee files are 
sent on time, and thus solve the scheduling problems described above, one could 
just increase the rate the data is sent over the satellite. But ttiis brings up another 
problem with multicast - data throughput varies. For example, suppose five out of 
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six cable headends where the cable equipment operators maintain their equipment 
have state of the art, well maintained equipment that can receive data at 100Mbps 
(one MBps is equivalent to one million bits of data per second). One of the six head 
ends can only receive data at 10Mbps. In this situation, if all six need to receive the 
file within a certain designated time, increasing transmission bandwidth will not 
guarantee a transmission stop time because there is a "weak link in the chain," 
namely the 10 Mbps head end. Thus, transmissions must be made using a 
"dynamic" allocation of bandwidth and transmission time that accounts for tiie 
varying throughput of various system components. An allocation is dynamic if the 
system can change the time slice or data rate of the transmission. 

This invention provides a distributed-hierarchicai scheduling control system 
that monitors the network and adapts dynamic rate allocation, time slicing and 
logical framing to optimize system resources. 

Summary of the Invention 

This invention addresses these issues by intiDducing dynamic rate allocation, 
dynamic time slicing and logical framing, and a distributed, hierarchical contx>l 
system. According to the methods and systems of ttiis invention, adaptive network 
programming optimizes resource allocation. This document briefly describes 
systems and methods for the effective sharing of a satellite transponder between 
muttipie satellite uplink stations using out-of-band tenestriai signaling/control. Using 
an out of band communication link such as a separate communications networic like 
the Internet, VSAT, or frame relay witti an efficient protocol, transponder sharing 
among satellite uplink stations can be controlled and automated. The automation 
process will minimize idle time, which means additional satellite capacity for ttie 
users. 

The present invention advantegeously enables a distaibuted set of uplink 
station tedlrties to effidentiy share an outisound satellite link without requiring the 
expense of two-way RF or satellite transmission. Requests and resulting channel 
assignments are specified in terms of scheduled transmission times within a variable 
time horizon. Accordingly, the system can offer either a scheduled batoh 
transmission service mode or an interieaved, time division multiple access mode. 
The master arbitration sen/er provides a master clocking reference for 
synchronization. This clocking reference may be generated from a highly accurate 
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local reference (e.g., an atomic clock) or may be slaved to an extemai source, such 
as the GPS network. 

This Invention effectively shares a limited amount of satellite resources with 
multiple remote sites and satellite transmitters. Using an out of band control in 
accordance with the present invention supports use of the satellite transponder for 
either analog video or high-speed data transfers. Two way data communication is 
also possible using the satellite for the outgoing high-speed data transfer and the 
control path as the return data path, and "path-switching" between two or more 
transmission sites in a half-duplex communications fashion. 

Among other objectives, this invention aims to overcome the problems of the 
current environment of satellite transmissions that use static channel assignments, 
witii scheduling based on manual time reservation mechanisms. The non- 
deterministic file distribution predictions available under prior systems causes 
scheduling difficulty in that future start times cannot be precisely predicted. On ttie 
other hand, because multicast throughput is variable, multicast file distribution that is 
based only on changing the rate or band width of tiie connection still does not solve 
the problem. 

In one embodiment, this invention uses a system of master and sub- 
controllers to overiay, adaptively, dynamically or botti. rate and time slice allocations 
upon a common set of networic transport resources. These networic transfer 
resources may be in ttie fbnn of wireline, wireless, satellite or ottier communications 
network capacity. A master ariaitaBtion sen/er receives access requests from 
multiple local (or remote) contaiollers, each of which desires to schedule a file 
transmission over a communications resource such as a satellite. The access 
requests include infomiation that tiie master ariditration sender uses to assess the 
priority of tiie file transmission. A schedule for satellite use is set based on this 
information. The master arisibation server returns to each local art}itration server 
infonnation concerning tiie time slice to which tiiey will have access to the satellite 
tiBnsponder for using satellite capacity. 

Local arbitration servers, in turn, have authority over their use of the time slice 
assigned for their use. The local arbitration servers may subdivide their time slices 
based on tiieir local needs and the priorities of the files they need transferred, 
resulting in a file transmission scheme that is similar to a time division multiplexed 
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scheme. In addition, however, the local arbitration servers also may set the file 
transmission rate (e.g., bandwidth) to be assigned a particular transmission. In 
essence, this system provides an overlay of time slicing and rate allocation by which 
the distributed control system can specify a window of time and a rate in order to 
ensure better file transmission. 

Another advantage to using local arisitration servers is the distributed 
intelligence achieved in the system allows for dynamic reaction to events. This is 
best explained by example. Past transmission system schemes have static 
retransmission schema. Thus, the system might try to send a file 7 times before 
giving up. The problem with this approach is that the static schemes add to networic 
rigidity. The system can become unstable because it receives problem jobs that 
require retries and then either delay other jobs, causing a ripple effect on the 
schedule, or simply do not get sent Meanwhile, new jobs are entering the system 
for transmission. The local art)itration servers of this invention allow ttie system 
dynamically to decide whether to keep trying to send a particular file or job or 
whether to move on to tiie next file. Also, the local arbitration servers can decide to 
send part of ttie file now and hold tiie rest for transmission in another time slice, 
resulting in tiie local arbitration server efRdentiy using some of ttie assigned capacity 
and getting at least a portion of ttie file complete. By using a system having a 
master artsitration sen/er and a number of local artsitration senders, ttiis invention 
promotes efficient reuse and sharing of previously dedicated networic ti^nsport 
resources. 

The invention may be adapted for using an internet protocol ("IP") multicast- 
based sen/ice for distributing various files. This service achieves large-scale 
distribution of the files, such as media files comprising shows, commercials, news 
events, sport events, etc., via an IP multicast within an adaptive reliability layer. The 
master and local arbitration senders bounce the use of networic transport resources 
with the respective priorities and sen^ice commitments associated with each file or 
set of files tiiat need to be distributed over the next system. 

This system may be implemented by coupling a master arbitration server to a 
communications networic that allows the master arbitration sen/er to communicate 
with various local arbitration servers, each of which are associated with a portion of 
the networic transport facilities. For instance, a local arbitration sender may be 
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associated with a satellite transmitter and the appropriate hardware necessary to 
package the data for satellite transmission. The master arbitration server may 
comprise a scheduling server that sets the basic distribution times for a file or set of 
files. The master arbitration server may assign a time slice and channel to a 
particular file. The master arbitration server fonivards that assignment data to the 
local arisitration server. The local arbitration server, depending upon the other jobs it 
receives and/or networic traffic data, will itself adaptively assign each of the multiple 
jobs a particular rate and, if appropriate, may further divide the time slices to which 
each job is assigned. The local arisitration sen/er thereby dynamically and 
adaptively overlays rate allocation upon tiie initial time slice assigned by the master 
arbitration server. 

Another aspect of this invention involves determining the rate at which files 
may be broadcast. As skilled persons will recognize, bottienecks in multicasting 
occur on communication links. Additionally, however, bottienecks occur because of 
the servers and clients receiving the files. For instance, each time a client computer 
opens a new application, that application detracts from the client computer 
resources otherorise available for accepting files, which, in turn, decreases the rate 
tiiat tiie client computer can receive file transfers. By providing feedback on the 
data rates handled by portions of tiie communications network, including botti the 
communications link and the clients receiving tiie files, tiie present invention can 
further improve multicast file transfer perfbnnance. 

Accordingly, using the methods and systems of this invention achieves at 
least one. more or combinations of the following advantages. The invention: 

• Can maximize the number of files transmitted to the maximum number of 
sites successfully at the highest rate possible. 

• Utilizes two degrees of freedom (rate and time) to manage priority and non- 
priority date transfers. 

• Provides best-effort and guaranteed service levels. 

• Utilizes distributed control and hierarchical bandwidth management agents. 

• Utilizes networic management stetistics to adapt bandwidth allocation. 

• Can emulate rate-proportional sharing (TCP/IP) for IP multicast 

• Can be deployed above stendard RF media access control mechanisms. 
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Other objects, features and advantages of this invention will become apparent 
from the rest of this document, including the Figures. 

Brief Description of the Drawings 

Fig. 1 is a diagram showing an exemplary topology for one embodiment of the 
system of the present invention. 

Fig. 2 provides additional detail of system components and resources that 
can be used to implement flie embodiment shown in Fig. 1 . 

Fig. 3 is a schematic diagram showing the interrelationships between ttie local 
arbitration servers and the master arbitration server of the present invention. 

Fig. 4 is a logic diagram depicting one metiiod for managing the channel, 
rate-time and band width hierarchy of various files to be multicast according to the 
present invention. 

Fig. 5 is a broad oven/iew showing ttie logical coupling point of several 
components of ttie system of tiie present invention. 

Fig. 6 is an overlay depicting the dynamic rate-time allocation for multicast file 
distiibution tiiat is accomplished according to the mefliods and systems of this 
invention. 

Fig. 7 depicts the priority queuing and bandwidtti allocation perfbmned by tiie 
multicast server according to the methods and systems of the present invention. 

Fig. 8 is a high level diagram depicting ttie interrelationship between the 
master arbitration server and various local arbitration servers. 

Fig. 9 depicts one request-grant protocol for implementing aspects of ttie 
present invention. 

Fig. 10 is a logic diagram depicting ttie adaptation mechanism by which the 
mettiods and systems of the present invention adapt to varying networic conditions in 
order more efficientty to distribute files. 

Detailed Description of the Drawings 

Before describing the drawings and embodiments in more detail, several 
tenns are described below in an effort to clarify tiie tenninology used in this 
document. Additional and fuller understanding of these temns will be clear to 
persons skilled in this art upon reading this entire document. 

• lOObaseT: Ethernet networi( 100 megabit per second interconnection. 
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• Client: A client is a program, which interacts with a Sen/er program that 
may be on a remote machine. 

• CRC: Cyclic Redundancy Check - a type of checksum used to validate 
data, generally after storage or transport. 

• DNS: Domain Name System 

• DVB: Digital Video Broadcast 

• EDI: Electronic Data Interchange 

• FDM: Frequency Division Multiplexing 

• IP: Internet Protocol 

• Local Arbitration Server this is a computer such as a workstation, which 
runs software to allow it to determine which jobs to put into the queue on 
what schedule and on what bandwidth. The local arbitration server has a 
view of the demand for the resources locally. 

• Master Arbitration Server this is a computer, such as a workstation, 
running network control software that manages overall resources and has 
a scheduling function. The master arbitration server allocates channels, 
an aggregate rate and/or an aggregate time slice. The master arbitration 
server "arbitrates" between the requests for sateiiite resources made by 
various content providers, the network capabilities and the local arbitration 
servers. 

• Multicast a process of sending a transmission to a selected subset of 
recipients (as opposed to point to point or broadcast). 

• MPEG2: Second generation digital video compression and transmission 
standard formalized by the Moving Pictures Experts Group. 

• NT: Short for Windows NT Server, an operating system from Microsoft 
Corporation. 

• Out of Band: Not transmitted with the signal in question. May be on a 
different frequency, or by another means altogether (e.g. Intemet vs. 
satellite). 

• PIDs: Program identifiers as defined by MPEG. 

• Priority Information: this refers to information that the arbitration sen/ers 
may use in order to assign a particular priority to a job. The information 
can be as simple as a pre-assigned priority code and delivery time to more 
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detailed information, such as the credit worthiness of the sender, the 
volume of business provided by the sender, the value of the infonnation, 
whether the sender will pay a surcharge for a particular service guarantee, 
etc. With such information in hand skilled persons will recognize that the 
servers or associated programs may assign a priority. An additional factor 
to note concerning priority infomiation is that while a request may contain 
some priority infonnation, other priority infomiation may be stored at the 
server and used in assigning the ultimate priority. 

• QPSK: Quadrature Phase Shift Keying 

• Scheduler A program that guarantees tiiat requested content has been 
successfully transmitted as scheduled. 

• Server A program that provides specific services to clients (e.g. database 
or protocol management). It is frequently is important enough (or busy 
enough) to run alone on a dedicated machine. 

• Signaling Channel: A separate channel used to control activity on other 
channels, or other processes. 

• TDM: Time Division Multiplexing 

• Uplink station: this refers to an aggregation of equipment for transmitting 
(or even receiving). Each station may contain data communications 
equipment for communicating with a networic or computer to receive files, 
upconversion equipment, an RF amplifier and the actual transmit dish. 

• WWW: Worid Wide Web. an Intemet hypermedia application. 
Overview Of The Present Imrention (Figs. 1-3): 

Fig. 1 depicts various components comprising a portion of the architecture of 
tiie system of this invention. A master control networic 100 aliovvs a master 
arbitration server 1 10 to control various local arbitration sen/ers 120. Each of ttie 
local arbitration sen/ers 120 is coupled to a local multicast server 122 and to a 
satellite transmitter 130. Each of the local multicast servers 122 store the content 
ttiat is to be distributed via the networic transport facilities such as the satellite 
networic shown in Figure 1. In concept, Figure 1 shows a distributed, hierarchical 
system in which each satellite transmitter 130 has a set of clients comprising various 
satellite receivers 150. The satellite transmitters 130 in tum have local multicast 
servers 122 that acts as a scheduler and a local arbitration server 120. Note that the 
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functionality of the multicast servers 122 and bandwidth manager 120 can be 
implemented on one or multiple workstations or computer platfomns. 

The satellite transmitter 130 communicates via satellite 140 to various 
satellite receivers 150 that couple via remote backchannel 160 to the local arbitration 
servers 120 and master bandwidth manger 110. Master arbitration sender 110 
couples to a database 112 supplied with network management data via a network 
management subsystem 1 14. The master control network 100 allows for out-of- 
band interconnection between various components of the system shown in Fig. 1. 
For instance, the master control network 100 can be a communications network 
configured for TCP/IP. VSAT, frame relay, ATM, or intemet communications. 
Similarly, remote backchannel 160 can be a backchannel for receiving downlink 
infomiation (e.g., confinmation of file receipt/transmission status) that can be a 
communications networic such as a packet switched network or the intemet. 

Figure 2 shows one implementation of the architecture shown in Figure 1. 
Figure 2 shows an implementation of the control system of the present invention in 
which multiple satellite uplink stations 210 share unidirectional satellite 202 
bandwidth by scheduling access for uplinking earth stations 210 via a central server 
220 placed in a centralized location for storing video data 222. Each of the uplinking 
earth stations 210 has access to the central server 220 through the Intemet (or 
some other suitable communications link). The central server 220 may control the 
allocation of bandwidth within one transponder, the allocation of multiple 
transponders on one satellite, and/or the allocation of bandwidth across multiple 
satellites 202. 

Each uplink station 210 comprises satellite transmission and fomiatting 
equipment known to persons skilled in the art. Associated with the uplink stations 
210 are one or more local multicast servers 212, 214, each of which provides the 
access control at the earth uplink station 210 and local storage for data 222 to be 
transmitted over the satellite 202. The multicast servers 212, 214 have access to the 
Intemet (or other suitable communications pathway) for communications with the 
central server 220, via a local signaling server. In addition, the uplinking earth 
station 210 site may have satellite modem equipment connected to the local 
multicast sen/er and satellite earth station transmission equipment. The central 
server 220 will schedule access for any individual, local multicast server 212, 214, 
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placed at any uplinking earth station 210. An illustrative embodiment of a control 
system architecture in accordance with ttie present invention is illustrated in Figure 2 
wherein two of a possible plurality of uplinks are shown. 

Each of the local multicast servers 212, 214 may store packetized data in 
files. Each file can be selected individually for transmission or grouped togetiier for 
transmission in a batch mode. Once a file has been selected for transmission, a 
selected protocol is followed for transmission. 

For instance, the local multicast server 212 may request a transmission 
window from the central server 220. master arbitration server 220 prioritizes 
communications across the satellite 202 resources available. Access to the satellite 
202 resources can be granted on a "first-come first-serve basis" or any number of 
priority schemes to provide a particular guaranteed quality of service (QOS). The 
central server 220 also may incorporate a bandwidth management system, which 
makes sure that tiie available satellite resource is never over-subscribed. In one 
protocol according to this invention, the centi^l sender 220 may provide ttie 
requesting local multicast server 212 a message deteiiing flie transmission window 
for the particular file transmission. The central server 220 authorizes the actual 
transmission over the satellite 202 by sending an authorization message for the 
designated satellite resource to the local multicast server 212 ttiat is scheduled to 
transmit No local multicast server may begin tiansmitHng date tiirough ttie satellite 
resource unless it has received tiie authorizing message, and not until the 
authorized stert time. The control system uses authorizing messages as the 
methodology to insure that only one uplinking earth stetion is accessing the satellite 
202 resources at any given moment. 

After it has received tiie auttiorizing message from the central server 220, the 
multicast server 212 manages the transmission of the date through the satellite 
transponder. At Uie exact autiiorized time, the carrier for the uplink station's 210 is 
enabled and tiie output of the multicast sen/er 212 feeds to the uplinking earth 
station's 210's modulation equipment. After it is modulated, it is then upconverted 
and amplified for transmission through the satellite 202 transponder. Any number of 
applications can be used to manage the flow of date over the satellite. Protocols 
known to skilled persons in this field can be employed to selectively retransmit date 
that was corrupted before being received by the earth stations. 
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The multicast server uses the Internet (or another suitable communications 
pathway) for communications with the receive stations or "clients." After it schedules 
a transmission with the central server 220, it contacts the client sites 230 through an 
open multicast group address. The open group is contacted and the members of 
the smaller transmission group are instructed to begin "listening" to a satellite 
resource for the transmission. Once switched to the new closed group address each 
client in the newly fomned "closed group" is instmcted to register with the multicast 
server 212, 214 that initiated the session. The server's IP address for this response 
is passed during the registration process. This response occurs over the Internet (or 
another suitable communications path for return data) and that client (or receive site 
232, 234) can now begin to receive the multicast data being distributed in that 
particular closed session. 

While a local multicast server 212. 214 is authorized to transmit, the central 
server 220 may send it an update message allocating increased or reduced 
bandwidth and / or changing its frequency assignment It may even ask the local 
multicast server 212 to pause its transmission. The multicast server 212 then takes 
appropriate steps to cause its group to make this change, and then retum an 
acknowledgment message to the central server 220. This alkyws the central sen/er 
220 to handle higher priority QOS requests, and to prevent the fragmentetion of 
bandwidth within a transponder. If the multicast server 212 finishes eariier than its 
allotted time, it may notify the central sender 220 of its intent to relinquish the time 
remaining. This allows the central server 220 to reallocate that time. It must leave 
its carrier on until it receives an updated authorization message from the central 
sender 220 telling It the exact time that it must turn off its earner It may request 
additional time in the same manner, but the transaction granting additional time must 
be completed before the end time of the original authorization. The multicast sender 
212 should shut down its carrier at the exact time specified in the cunent 
authorization message. 

Figure 3 presents a summary of the architecture of one system for 
implementing this invention. A master arbitration server 300, which ariDitrates 
amongst the various requests for satellite uplink time and the local arisitratton 
servers 302. couples via a communications networic 310 to various multicast servers 
320 located remotely from the art}itration server 300. Through an IP gateway 330, 
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the servers 320 push content into a standard DVB modulator 340 for uplinking over 
equipment 350 on the schedule and at the rate dictated, as described below, by the 
master and local arbitration servers. The uplink station has various components 
including the modulator 340, uplink equipment 350, or dish 360 for transmitting files 
to satellite 360. 

Dynamic Bandwidth and TimeSiice Ailocation (Figs. 4-8): 

Figure 4 shows a logical ovennew of a method of tiiis invention for 
dynamically allocating files rates and times for transmission over network transport 
resources such as a satellite. Figure 4 depicts a distributed control hierarchy in 
which the steps in area 420 are carried out by a master arbitration server 410 and 
tiie steps in area 420 are canried out by the local arbitration sen/ers. Master 
arbitration server 410 receives multiple requests for distributing content and assigns 
each request a specific channel, represented by frequencies F1, F2, Fn. Each 
channel has a number of time slots to which the master arisitration server 410 
assigns particular jobs. Thus, master arbitration server 410 subdivides channel 1 
into time slots T1 1, T12, Tin, in which the first subscript represents the channel and 
the second represents the time slice. The master arbitration server 410 may 
maintain a database describing tiie capacity on each channel available to ttie 
networic. 

Local ari3itration servers receive from the master ari)itration sen/er tiie initial 
time and channel information, as well as an inrtiai amount of bandwidtii. Therafter, 
each local arbitration sen/er assigns its jobs a rate and may furttier subdivide the 
jobs into different time slots and at different rates to make more efficient use of the 
resources allocated to that local artDitration server. Thus, Figure 4 shows in area 
430 where local arbitration servers add rate designator 1 to channel 1, time slot 1, 
resulting in a T1 1 1 to T1 1 n diflierent rates applied to tiie first time slot in the first 
channel. By way of example, suppose in Figure 4 that the master arbitration sender 
410 assigns a 30 second time slice to channel 1. Hierarchically, as seen in Figure 5, 
the next level is controlled by the local arisitration sen/ers 520, each of which 
communicate with the master art)itration sen/er 510 (the same as server 410 in 
Figure 4) and various clients 530, 532 that comprise, e.g., tiie uplink stations or local 
multicast sen/ers. Each local arbita^tion server 520 assigns a rate and may further 
subdivide the time slot into two slots of 1 5 seconds apiece at a rate of 5 Mbps each. 
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Without the further ume slicing, the system would be at the mercy of the random 
errors always present in file transmission, with the result that an enror may occur and 
delay the job. 

Figure 6 attempts to capture the degrees of freedom the hierarchical system 
of this invention provides in allocating rate and time to multicast file distribution. The 
columns shown in Figure 6 represent the different rates assigned whereas the rows 
represent the time slots. So. for each frequency, there is rate and time multiplexing 
of the IP pacicets in which the files are subdivided. Figures 7 and Ssimilariy shows 
how the local and master arbttration servers 720 and 722 (or 810. 820 in Figure 8) 
interact with the local multicast server 710 (which provides the content for 
transmission) in order to create a priority queue comprising the rate and time 
allocation for various jobs. 

Figure 9 depicts a particular implementation of a request/grant protocol by 
which the local arbitration servers infonn the master of their need for new 
allocations. As seen in Figure 9, in the Transmission Setup phase, the client that 
desires to send the job first sends a Request. In this instance, the client may be the 
local arisitration server, which has received a request for file transmission and priority 
information associated therewith. The request from local to master arbitration server 
provides a Queue Descriptor detailing priority information on the job. as well as a 
Delivery Request indicating completion time. The master arbitration server, which 
knows of the demands on the overall networi<, receives multiple Requests ft-om 
multiple clients. It analyzes, prioritizes and schedules the requests based on 
networtc resources, performance and request priority data. It then fonrards to each 
of the local ari!}itFation sen/ers a Request Response setting the rate, timeslice. 
channel ID (e.g., frequency) and a transaction ID for tracking purposes. 

Next, the transmission is scheduled and made by the local ari3itration server 
and associated equipment. It may be that during or after the transmission the 
master arbitration server may recognize that the local art}itration server needs more 
capacity to complete its particular job. For example, the master ari3itration server 
may have sent the local arbitration server only enough network transport capacity to 
complete part of the job in question, noted that deficiency and looked for additional 
system resources to allow transmission of the remainder of the file. Or. the master 
aribitration server may have received infomnation concerning resource performance 
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in the network (see Figure 10) that caused it to reassess whether the released 
resources are sufficient. In either instance, the master arbitration server 
automatically sends an Incremental Allocation to the local arbitration server 
authorizing it additional bandwidth (e.g., rate) or time on the same or a different 
channel. Conversely, the local arbitration sender also can ask the master via an 
Incremental Request Allocation for additional bandwidtii, time, channel capacity etc., 
based on the demands and perfomiance of the local resources at its disposal. 
Again, a unique transaction 10 will be exchanged as part of tiiese request/grant 
protocols, as well as appropriate job infonmation such as file size remaining for 
transport, etc. 

Using these techniques, the system of tilts invention provides much greater 
flexibility for file transport. For instance, instead of requiring tiie local resources to 
be tied up while trying to complete a file transmission a set number of times, during 
which other files or pieces thereof cannot be sent over tiie networic resource, using 
this invention allows tiie local ariaitration senders intelligently to adapt to networi( 
conditions. In tiiat manner, the local ariaitration senders can deckle to send a portion 
of the packetized file and schedule the remainder for later or decide to switch to 
another job altogether. This flexibility makes greater use of local resources since the 
local ari)itration senders can ensure that any ''gaps" in capacity are filled with pieces 
of jobs. Meanwhile, tiie master arbitration server still mainteins control over the 
overall use of networic resources and is able to build a picture of networic usage and 
capacity based on the requests for reallocations generated by the local arbitration 
servers. 

Adaptive Bandwidth and TimeSlice Allocation (Fig. 10) 

Figure 10 deteils another aspect of ttiis invention. In any communications 
network, it is important to monitor the performance of various networic resources, 
such as switches, routers, links and the like. This invention also adapts to changes 
in networic conditions whereby the monitoring information alerts the master 
art)itration sender to the networic conditions changes. By way of example. Figure 10 
schematically shows a simplified feedback loop whereby the scheduler, e.g.. tiie 
master arbitration server, receives information from a networic monitoring subsystem 
1010. such as Solaris Openview or the like, that provides a ti^ffic data feed 
concerning networic conditions. That infomiation is compared with the system 
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optimization objectives, such as quality of service, use of capacity, etc. Together 
those parameters are taken into account by the master arbitration server as it sets 
its initial schedule or bandwidth allocation map 1020. Of course, each local 
arbitration server also may receive a data feed describing general network 
conditions or the perfbmnance and capacity of the communications equipment 
associated with that local arbitration sender. 
Time Division lUuitipiexing Operation 

Another mode of operation of the central server and Signaling System 
Servers of the present invention allows a Time Division Multiplex (TDM) mode of 
operation, giving each uplink station a periodic fixed time slice on a round robin 
basis. The duration of the time slice may depend in each case on, among other 
things, the capabilities of ttie uplink station to begin, conduct, and end its 
transmission, but could be measured in milliseconds or microseconds. Each uplink 
station has an absolute time reference (such as GPS) which allows its exact 
synchronization with otiier uplink stations. The transit time from each uplink stetion 
to the satellite in use is fixed by tiie physical location of the uplink station relative to 
the satellite's orbit. It is tiierefore possible for the master ariaitration sender to tell 
each uplink stetion when to begin and end its transmissions such tiiat the 
transmissions from all of ttie uplink station in ttie TDM group are concatenated as 
cbsely as possible upon their arrival at the satellite. 

The auttiorizing message sent from tiie master arisitration server to each 
uplink stetion for TDM operation includes the sterting time and ending time as usual, 
and also includes the exact time slice duration and period (the time from one time 
slice for this uplink station until ttie next). All local calculations of transmit inten/als 
are absolutely deterministic, so tiiat all uplink stetions in the group remain in 
absolute synchronism throughout the period of the ti^nsmisston witiiout further 
interaction from ttie cental sender (atthough update messages, as mentioned above, 
are allowed). 

The advantege of this mode of operation is tiiat it allows a TDM group of 
almost any size to share a satellite channel for real-time audio or video conferencing 
or exchange of data, with a single set of uplink / receive equipment. A frequency 
division multiplexing approach (witii each uplink stetion allocated its own bandwidth) 
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requires separate equipment to receive and transmit to each participant at each 
location. 

New System Protocol 

This section of the document will describe an embodiment of an architecture 
that supports out-of-band signaling and control for transponder sharing. Using a 
single controller per channel on a transponder uplink stations can communicate with 
the controller to negotiate for transponder capacity. Using TCP/IP as the signaling 
mechanism will allow for support of dialup connection as well. This should be useful 
to anyone using a mobile uplink. The controller and the uplink stations may signal 
each other using the following protocol: Note: (parenthesis indicates state of 
parameters). 



Table 1: Basic Communication 


master arbitration server 


Uplink 


Idle 


Service Request (requested 

parameters) 


Sen^ice Auttiorized (granted 


(Uplink In Use) 


parameters) 




Heartbeat 


Heartbeat response 




Uplink finished (time expired) 


(Satellite Resource free) 






Table II: Transponder Busy 


master arbitration sender 


Uplink 


(In use, no satellite resources 


Sennce Request (requested 


available) 


parameters) 


Transponder Busy (next avail...) 


Queue Request (parameters) 


(Job in Queue) 




(Transponder free) 




Sen^ice Authorized (granted 


(Uplink in use) 


parameters) 
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Heartbeat 


Heartbeat response 




Uplink finished (time expired) 


(Satellite Resource free) 






Table III: Signaling Channel Broken 


master arbitration server 


Uplink 


(Transponder In use) 


(Uplink in use) 


Heartbeat 


Heartbeat response 






Heartbeat 


(no heartbeat, no response) 


(Timeout) 


(Timeout) 


(Satellite Resource free) 


(Uplink free) 




Table IV: Additional Signals 


master arbitration server 


Uplink 


Service intenrupted 


Uplink stopped 


(Satellite Resource free) 


(Stop transmission, Uplink free) 






Status response 


Status request 






Status request 


Status response 




Table V: Update from Uplink 


master arbitration server 


Uplink 


(Satellite resource in use) 


Update request (new parameters) 


Changes Authorized (new parameters) 


Authorization updated 



Table VI: Update from master arbitration server 
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Master arbitration server 


Uplink 


Update request (new parameters) 


Acknowledge receipt 




Notify Multicast group (new 
parameters) via satellite and Internet 




Receive acknowledgment from each 
member of group 




Make requested change 


Update authorization 


Acknowledge change accomplished 


Adjust satellite resource parameters 






Table VII: Other Control Via Web Console User Interfece 


Master arbitration server 


Uplink 


Schedule Event 




Status 




Maintenance 




Logs 








IP Data 


iP Data (over signaling channel) 



Using IP communication over satellite in one direction requires an IP gateway 
at the uplink station. Communication can be to any computer system with a DVB 
satellite card and a modem for creating a retum path, although skilled persons will 
recognize many other implementations (the important thing is that there be some 
intelligence and a communication pipe for retum messages). Either point to point or 
point to multi-point (multicast) communication can be used. For multicast 
implementation, the service provider may utilize VNI multicast service or implement 
one of the methods suggested by the IETF to minimize retransmission. 

In addition to the signaling protocol, adding an API on top of TCP/IP may 
provide TCP/IP applications, running at the uplink station, the option selectively to 
choose which data goes over the Internet or over the high speed satellite network. 
For example the API may include an "h .write" (high speed write) routine which will 
use the IP over satellite if the transponder is freed. Other routines may include 
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methods for query status of the satellite link. The API will include interfaces to the 
signaling protocol for requesting the usage of the transponder. The addition of this 
API will allow IP applications to request for high speed data transfer and then 
starting the data transfer possibly over the signaling channel until the capacity on the 
transponder is available. Details of the API will also be available in VNI*s Shared 
Transponder Technical Specifications document. Other considerations include: 

• Signaling dropped and reconnected 

• Extend period of transponder usage which could allow for the signaling 
channel to be disconnected during extended on&AAfay data transfer. 

• Quality of Sen/ice request and signaling control 

• Managing of multiple earners on a transponder. 

There are several standard controls, on the modulator, the frequency 
upconverter, and the high power amplifier, which can be used to control the output 
of the transmit link. Each makes it possible to bring the transmit link to a state of 
readiness to transmit data within milliseconds. The appropriate choice of controls is 
the one that minimizes the latency from the authorized time to begin transmission 
and tile presence of ttie carrier at the satellite. 

In addition to ttie potential requirement for physical switching, there will be a 
requirement for synchronization bits at the start of each transmission. A pattern of 
alternating 1's and O's similar to the start of an Ethemet data packet (10101010) will 
be required for some period of time to allow the receiver hardware to lock to a new 
transmitter on the networic. As suggested in the introduction, a synchronization 
clock between transmitters will also be required. This will help eliminate too lengthy 
a signal lock delay each time a change of contix3l for the networic is introduced. 

Out of band signaling over the Internet allows bidirectional half duplex 
communications (The Internet is used as the control link for ttie high speed patii). 
As a result, the protocol needs to be expanded with SS7 or equivalent protocol for 
high speed communications. SS7 or the equivalent should be available. 
Illustrative Applications of the Present Invention 

There are a number of potential applications of the present invention can be 
applied whenever there is a need to share a single satellite transponder or a number 
of satellite links among a networic of uplinking earth stations. 
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Application 1 - Scheduled transmission through a sinole satellite resource 

In this application a single upiinking earth station provides transmission 
services for a number of independent sources through a single satellite resource. 
The upiinking earth station is the only site that has access to the satellite resource, 
but there is contention among the sources coupled to the upiinking station for 
access time to the satellite, in this application, the control system can be used to 
prioritize and schedule access to the satellite 

In this example digitized video data is provided by the sources and is stored 
at the upiinking location in a video server. The system consists of a front-end 
application allows a user to view, browse, and select files for ti'ansmission. 

Once a file has been selected for transmission the Multicast Server will 
request a ti^nsmission time for that file from master arbitration server. In this 
example the Multicast and tiie master arbitration server may be one and the same 
since there is only one upiinking station. The Arbitrator server prioritizes 
communications across the satellite data link. 

The Multicast Server uses the Intemet (or another suitable communications 
pattiway) for communications with tiie receive stations or "clients." After it schedules 
a transmission witii the master arbitration sen/er, it contacts the client sites through 
an open multicast group address. The open group is contacted and the members of 
tiie smaller transmission group are instiiicted to begin "listening" to a satellite 
resource for the tiransmission. Once switched to the new closed group address each 
client in the newly fonned "closed group" is instincted to register with the Multicast 
Sender that initiated tiie session. The server's IP address for tiiis response is 
passed during tiie registration process. This response occurs over the Intemet (or 
some oUier communications path for retum data) and that client (or receive site) can 
now begin to receive the multicast data being distiibuted in tiiat particular closed 
session. 

The output of the Multicast Sender is fed to an IP gateway. Most 
manufacturers of DVB transmission cards provide an IP gateway to encapsulate the 
networic traffic within the MPEG2 transport data fomiat before it reaches the satellite 
transmission modulator. The modulator uses a digital modulation technique to 
modulate tiie data. The resulting signal is then upconverted and then amplified for 
transmission through the satellite to the clients. 
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Application 2 - Access to a single transponder by multiple uplinkinq earth stations 

In this application multiple uplinking earth stations require access through a 
single satellite resource. The uplinking earth stations contend for access time to the 
satellite resource. The control system can be used manage access to the satellite 
on a non-interfering basis among a network of independent transmitters. 

In this example multiple uplinking sites are transmitting analog video 
broadcasts to a centralized location using an "occasional use" transponder. The 
control system has resen/ed a block of time for the uplinking sites to transmit video 
back to a central location. The master arbitration sender schedules access to tiie 
transponder by multiple sites for short periods of time witiiin this block of time. 

Each uplinking earth station is outfitted witii a Multicast Server, which 
provides the access control at the eartti station. The Multicast Sen/ers may access 
to the Internet (or another communications pathway) for communications witii the 
master arbitration server. In addition tiie uplinking eartii station site may have 
satellite modem equipment connected to ttie Multicast Sen/er and satellite eartii 
station transmission equipment. The master arbitration sen^r will schedule access 
for any indivMual Multicast Server placed at any uplinking earth station. The 
functionality of the local arbitration senrer described above may reside on the same 
platfbmn deploying the Multicast Sen/er. 

The master arbitration server sends a message back to the requesting 
Multicast Server / local arbitration sen/er containing its transmission window. The 
master arbitration server auttiorizes tiie actual transmission over ttie satellite by 
sending an authorization message for the designated satellite resource to the 
Multicast Sen/er / local arbitration sen/er tiiat is scheduled to taBnsmit. No 
transmission may begin over the resource until an authorizing message is received. 
The master arbitration server uses authorizing messages as the methodology to 
insure that only one uplinking earth station is accessing ttie satellite resource at any 
given moment 

The master arbitration sender sends an authorization message, after which 
the Multicast Sen/er / local artDitration sen/er manages the transmission of the data 
through the satellite transponder The output of the Multicast Sen/er / local 
arbitration sen/er is then fed to the uplinking earth stations modulation equipment 
and then it is upconverted and amplified for transmission through the satellite 
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transponder. The transmissions would be received by the central location and stored 
for further processing. 

Application 3 - Access to multiple resources on a single satellite bv multiple 
uplinkino sites 

In this application multiple uplinking earth stations require access through 
multiple satellite resources on a single satellite. The uplinking eartii stations contend 
for access time to the individual satellite resources. The control system can be used 
to support a variety of analog or digital transmission fbnnats. but only one 
transmission fomnat would be used in any specific application. For instance, the 
control system could manage multiple analog video transmissions through multiple 
transponders or multiple digital transmissions through a single or multiple 
transponders. 

In this example, multiple uplinking sites are transmitting digitized video 
broadcasts to a centralized location using one of several Frequency Division 
Multiplexed (FDM) satellite channels resident on a single satellite transponder. The 
channels are available on a full time basis. The control system randomly schedules 
access to the satellite channels by multiple sites for short periods of time. 

Each uplinking earth station is outfitted with a Multicast Sen/er, which 
provides the access control at the earth station. The Multicast Servers would have 
access to the Intemet (or another communications pathway) for communications 
with the master arbitration sender. In addition the uplinking earth station sites would 
have satellite modem equipment connected to the Multicast Sender and satellite 
earth station transmission equipment. The master arbitration sen/er will schedule 
access for any individual Multicast Server placed at any uplinking earUi station. In 
tills example* the Multicast Server may also implement tiie functionality of tiie local 
arbitration server, particularly tiie ability to overlay new transfer rate or time slices 
onto a particular transmission job. 

The master arbitration server sends a message back to the requesting 
Multicast Server containing its transmission window on one of the available satellite 
channels. The master arbitration server authorizes the actual transmission over the 
satellite by sending tiie Multicast Server tiiat is scheduled to transmit an authorizing 
message for the designated satellite resource. The Multicast Sender needs to tune 
its satellite modem to Uie satellite channel to which it has been assigned for the 
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duration of the transmission. (An update message may cause a subsequent 
reallocation). The Uplink station must continue to transmit a earner even if it has 
exhausted its data until its authorization expires. If significant time remains, it may 
send an update message to the master arbitration server asking for an earlier 
expiration. No Multicast Sender is authorized to begin transmitting data over the 
resource unless it has received an authorization message. The control system uses 
authorization messages as the methodology to insure that only one uplinking earth 
station is accessing the satellite resource at any given moment. A Multicast Server 
must cease carrier transmission at the exact time specified on its current 
authorization message. 

After it has received an authorizing message from the master arbitration 
server, the Multicast Server manages the transmission of ttie data through tiie 
satellite transponder. The output of the Multicast Server is tiien fed to the uplinking 
earth stations modulation equipment that has been tuned to operate through its 
assigned satellite resource. The signal is then upconverted and amplified for 
transmission through the satellite transponder. The transmissions would be 
received by the central location and stored for furttier processing. 
Application 4: Remote Satellite Truck Transmission 

In this application, a remote video truck contains a Signaling System Server 
and Multicast Sen/er witti an Internet link (probably wireless, e.g. cellular). Many 
events covered are of short duration with an indetemfiinate start time, and a real time 
feed is not required. Instead of wasting satellite bandwidtii waiting for the event to 
begin, the truck can capture the event (either on tape, for an analog tiansponder, or 
directly digitized to the Multicast Sender for a digital transponder), then request an 
authorization. When it receives the authorizing message, it transmits the segment. 
At the expiration of tiie authorization, it powers down the earner, an "all clear" 
indication is given to the operator, and tiie tmck may be moved. 
Application 5: Virtual Teleoort 

Several uplink stations managed by the same master arbitration server for a 
specific satellite may have facilities to reach satellites not available to other 
members of the group. For example, an East Coast uplink station may be part of 
the same group as a West Coast uplink station looking at a satellite with continental 
US coverage. The East Coast uplink station may also have access to a European 
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satellite, and the West Coast uplink station may have access to an Asian satellite. If 
master arbitration servers control resources on all satellites, a virtual worldwide 
teleport may be established for scheduling resources between Europe and Asia, or 
any other two points. 

Application 6: Real Time TDM Based Telecommunication, includino Video 
Conferencino 

Using the real time Time Division Multiplexing strategy outlined above, it will 
be possible to use an master arbitration sen/er to assemble groups of managed 
clients for teleconferences. Existing videoconferencing equipment may be used. 
Only a small additional delay over and above a single satellite delay (probably on the 
order of 50 milliseconds for five interactive participants) will be incurred. Any 
number of additional sites may participate in a receive only mode with the 
appropriate Signaling System Server. 

The foregoing is provided for purposes of illustrating, explaining and 
describing several embodiments of the present invention. Modifications and 
adaptations to these embodiments will be apparent to those of ordinary skill in the 
art and may be made without departing firom the scope or spirit of the invention and 
the following claims. Also, the embodiments described in this document in no way 
limit the scope of the below claims as persons skilled in this art recognize that the 
present invention can be easily modified for use with other devices and systems. 
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1 . A method for dynamically allocating network transport resources 
comprising: 

• initially allocating the bandwidth and time slice for a particular transmission; 

• providing infomnation conceming the initial allocation to multiple, 
geographically distributed controllers, each of which are coupled to 
transmission facilities; 

• using the controllers to adjust the bandwidtii or time slice in order to optimize 
file transmission over the network. 

2. A metiiod for managing multicast file distribution over a 
communications networic comprising: 

• storing at a first server computer infomnation conceming the capacity of 
channels within a networic; 

• receiving at the first sender requests for access to communication channels 
within the networic, wherein each request contains at least some infomnation 
relevant to setting the priority to be assigned the request' 

• fonwarding to a local sender information ass^ning a selected request a 
priority, a channel, and an initial time slice and transfer rate for a particular 
request for file transmission; and 

• causing tiie local server to either adopt the initial time slice or tiansfer rate or 
to assign the request a different transfer rate, one or more different time 
slices, or botti. 

3. A method according to claim 1 or 2 further comprising the step of 
contacting the recipients of the file transmission in order to confimn receipt thereof. 

4. A method according to claim 3 further comprising the step of 
contacting a group of recipients of the file to be transmitted over tiie networic to 
infonn tiie recipients of a taansmission time. 
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5. A method according to claim 4 in which the file transmission is 
accomplished over a satellite communications network comprising at least one 
satellite and at least one uplink station. 

6. A method according to daim 4 further comprising the step of sending 
an authorizing message before any file transmission over an uplink station. 

7. The method of claim 2 further comprising the step of receiving data at 
the local server describing the capacity or performance of communications 
equipment coupled to the local server. 

8. A system for allocating networtc transport resources comprising: 

• a master art3itration server for making at least initial resource allocations, 
which initial allocations are provided to each of 

• at least two local arbitration servers, each of which communicates with a 
satellite transmission system and each of which is adapted to: 

a dynamically evaluate each request for transmission to determine whether 
to overtay upon the initial allocations an adjusted allocation changing the 
time slice, transfer rate or both associated with each request; and 

□ communicate with the master arbitration server regarding any changes to 
the time slice, transfer rate or both. 

9. A system of master and sub-controllers to overtay, adaptively, 
dynamically or both, rate and time slice allocations upon a transmission job for 
transmitting a file across a first communication networtc, the system comprtsing: 

• at least one master arbitration server adapted to allocate to a selected file 
transmisston job an initial channel, time slice and rate; and 

• two or more local art)itration senders adapted to communicate with the master 
arbitration server and, based upon the priorities of the jobs assigned to each 
local arbitration sen/er, assign different rate, time slice or channel infonnation 
to a selected job in order to ensure efficient use of resources in the first 
communication networtc. 
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10. A system according to claim 9 wherein the communication between 
the local and master arbitration servers is conducted over a second communications 
network. 
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FIG. 2 
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